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the trend By athaenk évaluaticn of ¢ollege faculty ' 


“performance is documented, and implications for*husanization of the. 


university are considered. Research in the area of teacher evaluation 
is cited, and it is’ proposed that reviews of the literature on 
student evaluations indicate ky and large that student ratings are y 
reliable and valid, even though there“is a large body of, dissenting 


opinion. Students have obtained significant, influence in evaluation © 


. pf teaching effectiveness,.and administrators are thought to be 


viewing student evaluation of teacher effectiveness,as more reliable 
and valid than. colleague evaluation or informal observation. There 
still remains the question of how feedback on teacher perfcrmance can 
be used constructively for teacher growth and isprovesent. Evidence 
seems to support the noticn“that teacher morale has declined 
decidedly on many campuses. It is suggested. that if inert sethods of 
evaluation and accountability -.freseures cause,poor morale of faculty 
members, there is a need for reanalysis of the issues. Clarification 
of whether evaluation of instructors is to improve teaching 
effectiveness or to determine who will be promoted or tenured is 
needed. Student ratings need.to be carefully weighed in view of the 


‘complexity of the nature of the process. Ontil further research is 


accomplished to develop sqphieticated and tested evaluation forms, _ 


‘current student evaluatiom should. te kert in perspective.. (S#) 
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Ages of wisdom have dictated a rule that say$ 
eo *“ “charity begins at home.” It might not be too far 
| .afield to suggest that in an age of humanistic 

endeavor “humanism begins at home." 

specifically with respect to the vast and 

. complicated issue of evaluation and accountability 

demanded of professors in our academic 

institutions today..| use humanism in the sense that 
. “third force” humanistic psychologists might use it. 

Humanism nurtures special regard and concern for 

the individual and for what is human even when 


ak 


increasing size and technology dehumanize and 

o depersonalize the pulse of institutional and 
mM interpersonal enterprise. Pa 
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Columbia; 1968, and subsequent student revolts 
were snowballs that grew to become potential and 
in some instances regal avalanches. As a result, . 
what students think and feel about their educational Lom Oe 
experiences have become increasingly significant. 

The campus violence and riots‘of the late 60's 

brought institutions up short, made them heed the 

shouts of students, made them respond to their 
demands and in some instances even cower at 
their threats. It did not take long for “student 
power’ to make itself felt. ‘ 

One area itrwhich the student voice was heard and ° 


continues to be heard is instructional evaluation. « 
There are few institutions today that do not have ~~ 


? 
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some form of student rating of teacher 
performance. And, though people like 
contend that “evaluations of professors 


reliable and valid criteria for assess ent of / 
instruction. | j 
Research in the area of tea¢her valuation has/ ' 
been getting increased atfentigh in the last fa 
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A seg6nd study undertaken by Centra had as its 
priplary purpose to examine at length the effects of 
student feedback on teaching at the Lollege level.5 
Researchets such as Tuckman 9x4 Oliver,® Gage, 
unkel, and.Chatterjee,’” and ‘Bryan® had 


, / discovered at the high school and elefhentary level ~ 


that there were gains in teacher ratings as the 
result of student feedback. Miller, however, ina 
study which admittedly had limitations, discovered 
no significant change among college teachers as a 
result of feedback.® Centra's investigation of 
student ratings, therefore, focused on college level « 
teaching. He included.two groups in his study. For 
the first-group, student ratings only were shown to 


* instructors with little or no interpretation'to 


accompany the ¥atings, the typical procedure at 
most colleges. Interpretation of results was made 
available to the second group. 


-Centra’s study led to the conclusion that student 
ratings can effect changes, in teaching, especially 
for those tsachers who have “unrealistically high 
(compared to their students’ views) opinions of their 
instructior.e! practices."'° Festinger’s notion of 
congnitive dissonance may be a factor here.'! * 


Centra also found that instructional changes would 
take place especially if teachers “are provided with 
information to help them interpret their own 
results."'? The study underscores the eed for 
comparative or “normative” data for the teacher. 


‘ Frey's research is concerned chiefly with the kinds 
of information that should be solicited about 
instruction and how it should be solicited.’3 He 
beliéves, too, * via there is generally a positive 
relationship betwee student ratings and good 
teaching but that ene of this relationship. 
depends critical e technical ee of 
the rating ques Banas: oe : 


Extensive reviews “ofthe literature on Fr atdait 
evaluations’S indicate by dnd large that student 
ratings are reliable and valid, even though there is _ 
a large body of opinion that believes the opposite. 


~ Typically, they (the faculty) claim that 
student ratings are unreliable, that the 
ratings will favor an entertainer qver the 
instructor who gets. his “material across 
effectively, that ratings are highly | 
correlated with expected grades (a hard « - 
grader would thus get poor ratings), and 
* that students are not competent judges of 
instruction since long-term benefits of ar 
course may not.be clear at the time itis,’ 
rated.'6 | j 


Costin and his associates abe however, that 
“students can rate classroom instruction with a 


a 
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reasonable degree of reliability.""7 They refer to a 
host of studies such as the research done by 

_ Spencer and Aleamoni,'® Costin,'® and Guthrie,?° 

* which shows moderate to high correlations 
‘between student rankings of teachers from one 
year to the next. . os 


Costin and his associates approached the question 
of validity by citing 20 studies which show either no 
relationship or a weak relationship between .“ 
students’ grades and their ratings of instructors and 
courses. This finding refutes one of the chief 
arguments against the validity of student ratings, 
that teachers who give high grades, receive iD 
student ranngn 


Extensive reviews of the literature on 
student evaluations'‘indicate by and 
larg@ that student ratings are reliable 
- and valid, even though there is alarge 
body of opinion that-belleves the 
opposite. — is =z e 
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Citing French,?" Crawford and Bradshaw,?? and 
Musella and Rusch,?3 Costin and associates point 
out that the criteria students use in evaluating 
instruction are consistent and are not unlike the 
elements most contributive to learning cited earifer 
by Centra in his SIR instrument: 


Among the most frequently mentioned 

e Characteristics were expert knowledge of 
subject matter, systematic organization of . 
course content, ability to explain clearly, * 
enthusiastic attitude toward the subject, 
and ability to encourage thought.?4 


They also point to the fact that while a study by 


‘ 


Royce suggests that high ratings by students were - 


largely the function of “superticial popularity,"25 
Weaver refutes this contention by reporting that 
Students’ ratings of instructors were not a prorkict 
of the popularity “halo.” 


Centra’s review of research answered the typical . 
questions raised by opponents to student 
evaluation. ' 


Do students with “higher gradepoint 
average rate instructors differently than 
students with a lower gradepoint 
average? Guthrie reports they do not.2” 


Are student ratings reliable? Remmers?® 

and Guthrie?° report that when 25 or mare 

ratings were, averaged, rheans were as 

reliable as the better mental tests avail- 
, + 
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en 
able. Centra, using an intraclass measure 
of reliability, reports that ratings at 
Michigan State were similarly consistent 
for most items.2° F : 


Do male and female students diftgy in their * 
ratings instructors? Remmers and Elliott" 
‘and Spencer®? indicate they do Not. 


Ig there arelationship between the ratings 
a student gives the instructor and the. 
grade he gets or expects in the course? 
Some studies indicate that there is asmall 

* but significant relationship between these os 
factors.5° Other studies report no ° rn 
relationship, a * 


Does the curriculum or the students’ year. 9 
in college have any bearing on their "e% 
course ratings? Spencer reports they 

‘ have little or no relationship.*5 ' 


Do ratings of alumni differ from the - 
oncampus ratings of instructors? Drucker | 
and Remmers found that alumni, ten 
years away, agree (r’s between .A0 and 
. 68) with students :in their cone? of the 
same instructors.°6 


Do teacher personality measures and ‘s 

student ratings have a relationship? we 

Borg’? and Bendig?® ‘found the es 
relationship. insignificant. Isaacson, - 
McKeachie and Milholland, however, re~ 
port that psychology instructors rated high 
in “general. cultural attainment” by their 
peers tended to receivé good ratings from 
students.3° Cosgrove supports this fatter 
finding,*° while Filey, Ryan and Lifshitz 
indicate that in subjects other than 
psychology, students may rate other fa 
‘ulty qualities as important. a 


Thus, restéarch studies of varying levels Ce) 


students have gained siniicant intl 
evaluation of teaching apopeti f ayd 


effectiveness.*2 “In ide 
evaluating overall fa erformance, it oa 
teaching as pivotal. “ 


They indicate furtWer that there ' ‘is a decline i in 


. 
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~ actions.’ We Hardly ever mean the more positive 
‘he will profit from the ei wale of his 
action’."47 


“paeause they “are unsyste cking the There is enough evidence to Support 
" objectivity.and control ne to adequate ; the notion that a decided decline in. 
0, séveral dangerous teacher morale is a current ’ 
rocess. Instructor : phenomenon on many canines: 
t, and distrust, He says, will pe. 
aroused becayse the process is a “threat to the 
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heprofessor” and an invasion of It might be well here to return to the opening 
S nsibility. Furthermore, those who statement in t aper; namely, that in an age of 
: at student evaluation can heighten‘the humanistic endbavor, humanism begins at home. if 
_ profe Ssof's sense of responsibility, increase his evaluation and accountability have failed to’ 
iyation, and thus improve instruction’-are in produce an atmosphere of growth, health, and 
erpor because their argument is based on the productivity, if they have become negative 
otion that external sources of motivation are reinforcers and have proven to “alienate professors 
legitimate and effective.*4 ; . é from a vital part of their work,'"48 then something is 
/ ~ Ithas often been contended that a student's awry and our humanistic posture is a facade. 
motivation to achieve and improve, though perhaps There is enough. evidence to ‘Support the. notion that 
rged and inspired by a significant otherorsome . a decided decline in teacher morale 'is 4 current | 
external agent, ultimately comes from withinthe + | phenomenon on many campuses. Tension, 
student him/herself. Perhaps the same principle ‘factions! hostility,"and mistrust are often prevalent. 
applies to the teacher's motivation to improve or It behooves us to examine why these exist. If one 
desire for effectiveness. It cannot be coerced; of the causes of decayed morale’is inept methods 
rather it must come from wily the teacher of evaluation and accountability préssures with all 
him/herself. 8 * - their consequent implications, a quick response is 
- Does this mean that evaluation, feedback, and the in order. Institutional excellence cannot be 
call to accountability have no meaning? Decidedly, maintained in a climate of dying morale. 
not. From its inception | with Kurt Lewin,the concept Therefore, since we are in a time of increased 
_ _ Of “feedback” has received increasing respect and © evaluation-and accountabililty, there are several 
* its effects have been tested and measured in the questions that need to be continually and carefully ' 
whole arena of human relations and behavior examined. For one'thing, we must clarify why we 
change. Student feedback is valuable as a are evaluating our instructors. Is it to improve the . 
provocative and corstructivie means forteacher . effectiveness of their teaching of is it to determine 
« growth andJmprovement. The question is how this -who will be"pfomoted, who will get tenure, who will 
teedback is to be attained and what will be done , get salary increments? It would seem that our ” 
with it. me . current situation in many institutions lacks clarity of 
Harnett, in speaking of accountability in higher motives and perhaps this lack of clarity muddies 
education, has sdid, “In many ways, educational the entire process of evaluation. Even the most 
accountability and evaluation are essentially the Sophisticated instruments would fail to achieve the 
same. Accountability, like evaluation, is aimed at __—‘Fight end in this instance. 
learning about the effect of educational As Kerlinger indicates, “the basic purpose of any 
institutions."45 However, he goes on to point out ‘evaluation procedure is to evaluate instruction and 
that: “accountabiwy has brought with it the-notion of not instructors, to determine whether the 
external judgment,” and “at least from the reactions instructional objectives have been reached and l 
* of many elementary and secondary school ‘how well they have been reached."49 Of course, he 
teachers, there is a clear indication that ‘ further maintains that “it makés little difference 
‘accountability’ is regarded as a vindjctive rather whether students like or do not like-a course or an 
than an affirmative process.”46 ‘ ¢ — instructor. It really doés not matter.if an instructoris  - 
McGahan raises a similar issue when he looks _ - interesting or dull. Attaining the course's intellectual 
Upon accountability as a negative reinforcer. “If we and value goals is what matters."5° oy 
say that someone is accountable we usually mean Frey, in his concem for the kinds of information we 
that ‘he must suffer the consequences of his solicit from students and how we obtain it, makes 
® 
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“ clear that the student should be viewed as “an 


‘ information source rather than-an evaluator.” One 
should not tolerate questionnaires containing rating 
items “worded in terms of observables and 
statements of opinion or attitude” or that fail to treat 
“the teaching sitdtion as one having many 
cinafisiens: that should ne tated paid nae a 


walt would be well to rapid ourselves 

that we are still a distance from 

adequate: evaluative processes and . 
procedures and that we must regard: 
- the extant ones sch this cat 


Finally, it might be well to underscore Frey’ s 
“poignant contention that . . 


it is important to take into account the fact 
that students’ perceptions are a product of 
their own personalities as well as of the 
teacher's behavior. Thus the impression 
that a teacher creates depends not°only 
on his own behavior but also on the 
behavior and. expectations of his 
audience. Any analysis which assumes 
that teacher ratings depend entirely on the 
target and are independent of their source 
‘will be woefully sn ee sof 


A great deal of research needs to be done in the 

_ area suggested by this last point. If we agree with 
the Perceptual deka ALD 
nologists, we give credence to the notion that each 
individual possesses a perceptual field that 
influences the meaning’ and conclusiour's he 
arrives at. Combs cites an illustrative example: 


Several years ago a friend-of mine was 
driving in a car at dusk along a Western 
road. A globular mass, about two ‘feet in 
diameter, suddenly appeared directly in 
the path of the car. A passenger. 
screamed and grasped the’ wheel 
attempting to steer the car around the 
object. The driver, however, tightened his 
grip oh the wheel and drove directly into 
the object. The behavior of both'the driver 
- andthe passenger was determined by his - 
* own (perceptions). The passenger, an 
Eastetner, saw the object in the highway 
as a boulder and fought desperately to 
« sfeer the car around it. The driver, anative 
Westerner, saw it as a tumbleweed and 
devoted -his effprts to keeping his 
passenger from qverturning the car.5° 


Again, all of pis is ngAlo suggest that student 
“ ; 


_ we are still a distance from adequate evaluative a3 


ratings have no reliability or validity and that’they 
should be dismissed. It is only to suggest that they - 
need to be carefully weighed in light of the - Zi 
complexity of the entire nature ‘of the process and .. 


2 thaf, for the sake of hu anism, we do not trample . ’ 
_on the evaluatee by failing to Fecognize this ae ‘ 


complexity. Although research mounts and studies 
multiply, it would be well to remind ourselves that 


processes and procedures and that we must regard: . ‘ 


the extant ones in this light. * 


If we do not believe this, we need only Jook at late. . oi 
such as the kind Seldin and Wakin report about - ~ as 
deans’ appraisals of evaluations: .". . .they feel 
éValuation on théir campus is too subjective, and ' 
that they have not succeeded in working out 
Satisfactory pracedures and methods." While 
some institutions. have achieved a degree of 
sophistication in their evaluaton process, there are © 
still some whose deans admit, “I am sorry to report 
that we have not made:progress (inteaching —_ 
evaluation)”; “In this my nineteenth year as a 

faculty member and my third as academic dean, | 
am still unable to suggest a truly valid way of ; 
evaluating faculty members”; and “We arenot ~ , 
Satisfied with this (evaluation form). We are trying 

to improve it from time tg time. . .but nothing has 
been done toward final revision.”55 


- To institutions whose deans could make similar 


admissions, caution and humanistic admonition are 
in order. Destroy crude and illegitimate rating - 


*. forms. Investigate the educational field and unearth 


sophisticated tried-and-tested forms. Until further ° 
research is accomplished, keep current student ~ 
evaluation in perspective: Preserve and nurture the 
“human professor” while the mechanistic © 
instruments are.refined. Finally, and perhaps most 
importantly, learn from the field of psychometry that 
an instrument is more often than not only as goad © 
as its interpreter. 


Conscientious educators would not indulge in 
administration of an instrument designed to 
measure student performance without following up 
its administration with a sophisticated interpretation © 
to the student in a counseling sessidh. Therefore, 
we must ask who interprets for the teacher the 
meaning of student ratings? Is there an ongoing \ 
counseling process for teachers and professors 
reflecting a warm, empathic-climate and an 
atmosphere of positive reinforcement? Or must this 
kind of question be asked only with tongue in 


_ cheek? 


4 . 
Humanism begins at home. What we prescribe for ‘ 
our students, we might do well to prescribe for 
ourselves. 
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